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Abstract: In this paper, first-passage probability of Markov chains is used to get a strict 
proof of the existence of degree distribution of the LCD model presented by Bollobas (Ran- 
dom Structures and Algorithms 18(2001)). Also, a precise expression of degree distribution 

f-n* \ is presented. 
■)—> . 
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Introduction. Networks exist in every expects of nature and society. Most of the systems, 
e.g. WWW, movie actor collaboration network, transportation network and so on, can be 



described as complex networks. Thus, complex networks becomes one of the important 
research areas in recent years. 

Two important discoveries about complex networks is the small- world property [11] and 
the scale- free property, proposed by Barabasi and Albert [1]. They had a research on World- 
Wide Web and found that the degree distribution of the WWW is not Poisson, as random 
networks and small- world networks shows, but a power-law distribution. In[l], they pre- 
sented the approximate expression of network degree and used computer experiments to get 
7 = 2.9 ± 0.1. It is stated that after many steps the proportion of vertices with degree d 
should obey a power law P(d) oc <i -7 . In [4] they stated an evolving network(BA model) with 
growth and preferential attachment. They used the mean-field method to compute for the 
degree distribution, and deduced 7 = 3 heuristically. They thought that the probability of 
one vertex to get edges equals mll(ki). That is to say, it is in direct proportion to degree of 
the vertex and the number of edges added at a unit time simultaneously. They also pointed 
out that most real networks are scale- free [2]. 

In order to make a better understanding of the phenomenon in real networks, many 
scholars did researches on BA model, they also had extensions to BA model and got a lot 
of useful results. 
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Krapivsky[12] let Nk(t) be the number of vertices in network with degree k at time t. They 
deduced the rate equations: dN ^ = m ^ k ~ 1 ^^ k 1 ^^) Nk ^ + &km and used lim E[N k (t)/t] = 

k 

P(k) to show that P(k) = fc ( fc+1 )( fc+2 ) f° r the BA model with m — 1. 

Dorogovtsev[8] considered fcj(i), the degree of the vertex added at time i evolved at time 

t. They used P(k, i, t) to express the probability of vertex % having k edges at time t. And 

t 

let the average degree P(k,t) = \ ^2 P(k,i,t) to be the network degree at time t. They 



=i 



presented the attraction model, where each new vertex has an initial attraction degree a. 
Thus, k = a + q is the total degree with q being the in-degree of the vertex. They got 
the master equation: P(k, i,t+ I) = ^-P(k — 1, i, t) + (1 — ^)P{k, i, t) and the stationary 
distribution: P{k) = ^+™{k+2) w ^h a = m. 

t 

These two definitions of network degree is equivalent, for we have E[Nk(t)] = Yl P{k, h t). 

i=l 

As to BA model, Bollobas[6] once raised the following questions: The first is getting 
started: how do we take probabilities proportional to the degrees when these are all zero? 
The second problem is with the preferential attachment rule itself. For the BA model, or for 
any other BA-like model, how to find a rigorous preferential attachment scheme for m > 2? 

Aimed at this questions, Bollobas[5] presented a modified BA model, called LCD model. 

As Bollobas[5] stated: We start with the case m — 1. Consider a fixed sequence of vertices 
vi, i>2, • • • . We shall inductively define a random graph process (G\)t>o so that G\ is a directed 
graph on {i>j : 1 < i < t}, as follows. Start with G\ the graph with no vertices, or with G\ the 
graph with one vertex and one loop. Given form G\ by adding the vertex v t together 

with a single edge directed from v t to v i} where i is chosen randomly with 

p{i = *} = \ v - s z! ' (1) 



2t-l 



S = t. 



For m > 1 add m edges from v t one at a time. We define the process (G^)t>o by running 
the process (G\) on a sequence v' 1 ,v' 2 , ■ ■ ■ ; the graph G^ is formed from G™* by identifying 
the vertices v[, v' 2 , ■ ■ ■ ,v' m to form V\, identifying v' m+1 , v' m+2 , • • • , v' 2m to form v 2 , and so on. 

Bollobas[5] found that, although the graph process {G\} is dynamic, there is a static 
description (Linearized Chord Diagram) of the distribution of the graph at a particular 
time. In [7], they studied ^(d), the number of vertices with indegree d and strictly proved 
the following equation 

F( an i j\ \ 2m(m + i> 

lHml ~ (d + m)(d + m + l)(d + m + 2) ' 1 ' 

Then, with Azuma-Hoeffding inequality [10], they got the following theorem. 

Theorem Let m > 1 be fixed, and consider the random graph process (G^J n >o, writing 
tJm(^) f or the number of vertices of G^ with indegree equal to d, i.e., with total degree m + d. 
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Let 

2m(m + 1) 
am ' d = {d + m){d + m + l){d + m + 2) 

and let e be fixed. Then with probability tending to 1 as n — > oowe have 

ti n (d) 

(1 - t)a mA < < (1 + e)a m>d 

n 

for every d in the range < d < n,is. 

In fact, ([2]) already proved that tlm( c 0/ n convergent to a m ,d with first order. The theorem 
is used to prove that (j^(c?)/n tends to a m ,d with probability 1. If one is only interested in 
the degree distribution of the LCD model, ([2]) is enough. Also, Bollobas[7] changed the BA 
model and the method used in his paper is applicable only to particular models and it is 
difficult to have extensions. 

In this paper, we apply first-passage probability[9] to LCD model. We used the Markov 
theory and got a rigorous proof the existence of the steady-state degree distribution of the 
LCD model. And finally presented the precise expression of the degree distribution. 

Stability. Instead of studying martingale Xj = i?[jj^(d)|G^J(w;/iereO < / < T), we 
consider ki(T), the degree of vertex / at time T. Following Dorogovtsev[8], kj(T) is a 
random variable, and let P(k,I,T) = P{kj(T) = k} the probability of vertex / having k 

T 

edges at time T, also take the average degree P(k, T) — -= ^ P(k, I, T) to be the definition 

i=i 

of the network degree at time T. For fixed T, kj(T) is a random variable and for variable T, 
ki(T) is a nonhomogeneous Markov chain[13]. The adding of vertex / can be divided into 
m steps, from (/ — l)m + 1 to (/ — l)m + m. The state-transition probability of this Markov 
chain is given by: 

P{kj(T + l) = l\kj(T) = k} 

p U l l = k+j,j = 0,l,--- ,m (3) 
otherwise. 

where k — m, m + 1, • • • , (T — I + 2)m and P^lf 1 is the probability of vertex / with degree 
k at T increase by j at T + 1 . With (CQ) , it follows that 

p U l = IB 1 



2Tm + 2(r - 1) + V 

r=l v ' 

m b—l , , 

pT+i = VfTTfi - )( - ) 

kA =i 2Tm + 2(g- 1) + l A 2Tm + 2(6- 1) + V 

TT (1 k -±l )] 

J-l v 2Tm + 2(r - 1) + l Ji 

r=b+l K ' 



m , 
pT+l TT K + r 



2Tm + 2(r - 1) + 1 
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Consider the first-passage probability f(k, I, S) of the Markov chain kj(T). f(k, I, S) = 
P{kj(S) = k,ki(L) 7^ k, L = 1, 2, • • • , S — 1}. Based on the concept and techniques of 
Markov chain, the relationship between the first-passage probability and the probability of 
vertex degrees are as follows: 

Lemma 1 When 1 < I < S, k > m, we have 

in 

f(k, /, 5) = E P ( k ~ * I ' S ~ ( 4 ) 
When 1 < I < T, k > m, we have 

T T m 



p(k,i,T) = Ef(k,i,s) n n(i- 2( A-i )m+ Vi) + i )- ( 5 ) 

S=I A=S+lq=l 

Proof: From the construction of LCD model, the degree of vertex / is always nondecreasing. 
At S, the degree of vertex I can increase by 1, 2, ■ • ■ , or m. With the Markov property, we 
have 

f(k, I, S) = P{kj(S) = k,kj(L)^k,L = 1,2,- ■■ ,S-1} 

m 

= ^P{A; / (5) = fc,A; / (5-l) = fc-j}P fc s _ J -, 

i=i 

m 

= 53 P(A;-i, 1,5-1)^.. 

Thus (jlj) is established. 

Second, observe that the earliest time for the degree of vertex / to reach k is at step /, 
and the latest time to do so is at step T. After this vertex degree becomes k, it will not 
increase any more. 
This completes the proof. □ 

Lemma 2 When 1 < I = S, k = m, we have 

m 

f(m, I, I) = 1T(1 - r T — r ). (6) 

JK ' ' 1 A = A V 2(1 - l)m + 2(r - 1) + V yi 

When 1 < I = S,m < k < 2m, we have 

m 

f(k,I,I) = £ P{k - (m - r) - 2, /, ( I - l)m + r - 1) 2(f 

r=k—m fij\ 

T7 n — fc -( m - r, )+(g- r \ 

11 l x 2(/-l)m+2(g-l)+l /' 
q=r+l 
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Where P(k, I, (I — l)m + r) means the probability of the degree of vertex I to be k at the rth 
step of adding in. 

When 1 < I = S, k = 2m, we have 

2(r - 1) + 1 



f(2m,I,I) = H 



2(7- l)m + 2(r- 1) + V ' w 

Proof: For 1 < I = S, k = m, it means vertex J have no loops after the first m steps. For 
1 < I = S, k = 2m, it means vertex I have m loops after the first m steps. Thus (EJ) and (jHJ) 
are obtained. 

In order to prove (J2j), note that from step (/ — l)m+ 1 to (/ — l)m + m are all the adding 
of vertex /. At these m steps, the degree of vertex / will at least increase by 1. In order 
for the degree of vertex I first reach k at ( I — l)m + m, then at (I — l)m + r the degree of 
vertex I is at most k — (m — r). Thus ((7j) is obtained. 
This completes the proof. □ 

Stolz theorem: In sequence {^j, assume that {y n } is monotone increasing sequence with 
y n — > oo, if lim Xn + 1 ~ Xn — [ exists, where — oo < I < oo, then lim — = I. 
Proof: See [14]. 

Lemma 3 lim P(m, T) exists, and 

T^oo 

2 

P(m) = lim P(m, T) = > 0. (9) 

v ' t-,oo v ' ; m + 2 v ' 

Proof: From the construction of LCD model, it follows that 

T m 



2(J-l)m + 2(r-l) + l / A f/ +l ^ v 2{A - l)m + 2(q - 1) + 1 



P(m,I,T) = f(m,I,I) 11 rf(l-— — f 

A=I+lq=l K ' KH 

m T m 

~~ 2(1 - l)m + 2(r - 1) + 1^ U II^ 1 

In particular, P(m, 1,T) = 0. So, 

T T 

P(m, T) = -J2 P(m, I,T) = P{m, I, T) 

1=1 1=2 
^ T m ^ T m 

2(1 - Dm + 2(r - 1) + 1 

) n 



m 



2(/-l)m + 2(r-l) + r H H v 2(A - l)m + 2(o - 1) 

1=1 r=\ V ; 1 V J i A=I+1 q=l V ' KH ' 



T m 



fnna- 2M _ 1)f 'Vn+i 'tn' 1 - 



2M-l)m + 2(g-l) + r Lilv 2m + 2(r-l) + l' 

T m I m 

m 



S AC 1 2(7 - l)m + 2(r - 1) + 1 } JJ J^ 1 2 (P - l)m + 2(fc - 1) + V 
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Next, let 

m N m I m 

X N = n (1 - 2m+2(r-l)+l) + S II (1 ~~ 2(7-l)m+2(r-l)+l ) II II (1 ~~ 2(B-l)m+2(/i-l)+l ) ' 
r=l 7=3 r=l B=3 ft=l 

and 

iV m 

Thus, it follows that 

m JV+1 m 

x N+1 -x N = n(i - 2Nm+2 [ r _ l)+l ) n n( i - ^^^k^Ti rl> 



Y N+1 -Y N = (N + l -NY\(1 ^ r )) 

+ V iAV 2Nm + 2(r-l) + l" 

r=l v ' 

AT+1 m 

m 



nn(i- 2(A - 1)m+2to - 1)+1 >-'>°- 



A=3 g : 



Since > and Yjv+i — Fjv > 0, {1^-} is a strictly monotone increasing nonnegative 
sequence, hence Yn — > oo. Also, by assumption, 

„ „ EI (2A^m + 2(r - 1) + 1) + o(iV m ) 

AJV+l — Xjy r =l 



•y y m mm 

1JV+1 rjv ]l(2iVm + 2(r-l) + l)+miVE ]l( 2Arm + 2 ( r -!) + !) + o(iV m ) 

r=l i=l r^i 

-> — — ,(iV->oo). 
m + 2' v ; 

With Stolz theorem, we have 

P(m) = lim P(m,T) = lim — — = lim ^ +1 — — — = > 0. 

T^oo N^oo Y N N-+oo Y N+1 -Y N m + 2 

This completes the proof. □ 

Lemma 4 When k > m, if lim P(k — 1,T) exists, then lim P(k,T) also exists and 

T— >oo T— »oo 

P(fc) 4 kP(i, T) = ^P(* - 1) > (10) 
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Proof: With (jlj) and (jSJ) of Lemma 1, we have 

T— 1 

P(*,T) = i^P(M,T) + ip(A;,T,T) 

7=1 

1 T_1 T T m h 1 

= f EE/<M,s) n n(i- 2(A - 1)m+2(9 - 1)+1 )+r p ( t - r - r) 

7=1 S=J A=S+1 q=l K 

T-l T m , 1 

- f E/(M,i) n n(i- 2(A _ 1)m+2(g _ 1)+1 )+^ r ' r ' 

7=1 A=7+lg=l v 7 

T-l T m T in 

4e e e^-^-i)^,; n rid 



T ' ^— ' ^— ' J ' ' y J-l liv 2 (A-l)m + 2(g-l) + l' 

/=1 S=7+l j=l A=S+1 g=l v V ' V.* ./ ' 

T-l T m 1.1 

/m + f E E E 2(s - 1)m+ " 2 ( t _ 1) + 1 ^- 1 -^- 1 > 

7=1 5=7+1 6=1 v 7 v 7 

T m , 1 1 

n nd - 2( ^ 1)m+2fa - 1)+1 ' + + °¥ 



Consider f (T) firstly, obviously, f(k, 1, 1) = 5k,2m- Also, when 1 < I — S,k > 2m, then 
/(fc, 7, 7) = 0. With (J7J) of Lemma 2, when 1 < I — S,m < k < 2m, we have 

T-l T m , 



T ^,v y A1 A1 v 2M-l)m + 2(g-l) + r 

7=1 A=7+lg=l v 1 ^ ' 

1 ^ . 1^ ^ fc- (m — r ) — 1 

< f EM/,/x f E r E m2(/ _ 1)m+2(r _ 1) + 1 

T— 1 

lv^ fc — 1 , . lnT + 7 
Take limits on both sides, then lim f(T) = with m < k < 2m. 

T — >oo 



Then, with (jSj) of Lemma 2, when 1 < 7 = S, k = 2m, we have 

T-l T-l 

y( 1 + E(/_l)r 



T-l T-l 

/co < f a + E /( 2m ' J > J )) < ^ + E 773- 



7=2 



Take limits on both sides, then lim f (T) = with k = 2m. 

T — >oo 

Thus, when k > m, we have lim f(T) = 0. 

T — >oo 
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Now, consider the second item. 

T-l T m 



T m fc 



n na 



, , +J „ i 2(A + 2(,-l) + 1' 
fc-1 



T m ^ 

JL " 2(A-l )m + 2 (g -l) + l ) 

L V V (k-l)(S-l) X fc 

T£^2(S-l)m + 2(&-l) + l 1 ' 2(A-l)m + 2(g-l) + l J 



T m , m 



1 A; fc — 1 

T 11 II^ 1 - 2W-lW + 2(a-l) + l ){ E 2m + 2f6-n + l P(/C ~ ^ 



( ;i9= Av 2(A-l)m + 2((z-l) + l'^2m + 2(6-l) + l- 

+ E E 2 (S-% m l +2(b-l) + l P{k ~ hS ~ 1} JJ P (1 - 2(fi-l)m + 2(/ i -l) + i ri} 
Next, let 

^ £ 2m + 2(6"- l) + 1 ^-^) + ±£ 2(s + l Pfi-l.S-l) 

b — 1 S — 3 b — 1 

S m 

nn( i - 2 (s-i)m+2(/ i -i)+i ) 1}j 

and 

N m , 
Y N = N TT 1T(1 - — r — r r 1 > 0. 



Thus, it follows that 
in 

E 2iVm + 2(6-l) + l P(fc ~ N>) P II^ 1 ~ 2( J B-l)m + 2(/i-l) + l ) 

k 



(k-i)N D/L An n n/i fc 



Fjv+i-lAf = |iV+l-iVTT(l ; v 

+ 1 A = A V 2Nm + 2(r - 1) + 1 

AT+l m , 



)} 



2 (A-l)m + 2(g-l) + l ) * > °" 
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Since Y/v > and Fv+i — Yn > 0, {Vat} is a strictly monotone increasing nonnegative 
sequence, hence Y^ — > oo. 



Y N+1 -Y N N + 1 - N T\ (I k - ) k + 2 

r=l 

With Stolz theorem, we have 

P(k) = ]im{f{T) + ^P(k,T,T)+0{h)+ lim A v 



P(Jfe-l),(JV->oo). 



= lim = lim " = ~ 1) > 0. 

at-oo Fjv at-+oo Fjy +1 - Fjv k + 2 

This completes the proof. □ 

Theorem 1 The steady-state degree distribution of the LCD model exists, and is given by 

Proof: By mathematical induction, if follows from Lemmas 3 and 4 that the steady-state 
degree distribution of the LCD model exists. Then, solving (flOl) iteratively, we obtain 



/ . v k 1 , . , k X k 2 k 3 , x 

P(k) = P(k - 1 = — P(k - 3 . 

v ; k + 2 v ; k + 2k + l k v ; 

By continuing the process till k = 3 + m, we get 

P(k) = - ' m(m + 1} , ~ 2m 2 AT 3 > 0. 
v ; fc(fc + l)(fc + 2) 

This completes the proof. □ 

Conclusion The method of first-passage probability developed by Hou et al. [9] has great 
generality. We apply this method to the LCD model, and got the precise expression of degree 
distribution. Of course, allowing loops and multiple edges made the LCD model different 
from the BA model. Thus, the transition probability of Markov chains changed a lot. And 
the method is quite different from [9] . Moreover, the method presented in this paper can be 
extended to the attraction model [8] and other models with multiple edges. 
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